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Neutron radiography is a crucial nondestructive testing technology widely used in the aerospace, military, and 
nuclear industries. However, because of the physical limitations of neutron sources and collimators, the result- 
ing neutron radiographic images inevitably exhibit multiple distortions, including noise, geometric unsharpness, 
and white spots. Furthermore, these distortions are particularly significant in compact neutron radiography sys- 
tems with low neutron fluxes. Therefore, in this study, we devised a multi-distortion suppression network that 
employs a modified generative adversarial network to improve the quality of degraded neutron radiographic im- 
ages. Real neutron radiographic image datasets with various types and levels of distortion were built for the first 
time as multi-distortion suppression datasets. Thereafter, the coordinate attention mechanism was incorporated 
into the backbone network to augment the capability of the proposed network to learn the abstract relationship 
between ideally clear and degraded images. Extensive experiments were performed; the results show that the 
proposed method can effectively suppress multiple distortions in real neutron radiographic images and achieve 
state-of-the-art perceptual visual quality, thus demonstrating its application potential in neutron radiography. 
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I. INTRODUCTION 


Similar to X-ray imaging, neutron radiography (NR) ob- 
tains the internal structural information of an object by mea- 
suring the intensity attenuation of a neutron beam as it passes 
through an object. Owing to the special elemental attenua- 
tion characteristics of neutrons compared to X-rays and y- 
rays, NR is an important complementary detection method in 
the aerospace, military, and nuclear industries [1—4]. To date, 
clear neutron radiographic images have been mainly obtained 
using reactors and large-scale accelerators with high neutron 
yields (e.g., > 101? n/s). However, because of the high costs 
and paucity of reactors and large-scale accelerators, com- 
pact neutron radiography (CNR) technology—offering more 
flexible application scenarios—has globally attracted consid- 
erable research attention. Neutron radiographic images ob- 
tained via CNR usually suffer from multiple severe distor- 
tions, including mixed noise (e.g., Gaussian noise and Pois- 
son noise), geometric unsharpness, and white spots induced 
by the limited neutron flux, size of the collimator, and imag- 
ing detector, which hinder subsequent machine vision tasks 
such as defect detection and identification [5-15]. 

Generally, the quality of neutron radiographic images 
(NRIs) can be improved from both hardware and software 
perspectives. However, owing to miniaturization constraints 
and technical bottlenecks, increasing the neutron yield of 
compact accelerators, as well as upgrading the collimator and 
imaging detectors, are difficult once a CNR system is estab- 
lished. On the contrary, advanced image-processing tech- 
niques can significantly improve the visual quality of NRIs 
without modifying the hardware setup. Therefore, designing 
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a multi-distortion suppression method from the perspective of 
image processing is highly recommended to further promote 
the development and application of CNR. 


Image-distortion suppression aims to restore high-quality 
images with clear details from low-quality images degraded 
by noise and blur. In general, suppression methods can 
be classified into the following two categories: traditional 
suppression algorithms based on prior knowledge and deep 
learning-based suppression algorithms. Several successful 
demonstrations of traditional suppression techniques have 
initially been reported [16]. In 2015, Zhao et al. pro- 
posed a noise and blur suppression method for NRIs by em- 
ploying BM3D frames and a nonlinear variance stabiliza- 
tion algorithm based on the Anscombe transform [17]. They 
decomposed multiple distortion suppression into two sub- 
problems: Gaussian noise removal and deblurring. Although 
this method has shown improved perceptual visual quality, 
the noise suppression step may indirectly increase image blur 
to some extent. Subsequently, Zhao et al. proposed a ro- 
bust principal component analysis (RPCA) with a sparse rep- 
resentation method to identify and remove special white-spot 
distortion that typically exists in radiographic images [11]. 
Furthermore, the well-known software ImageJ is widely used 
by professionals to suppress white spots through a conve- 
nient manual threshold adjustment [18]. However, traditional 
suppression techniques can only be used to address simple 
restoration tasks with limited distortion types (i.e., < 2 ). 
In addition, it has the latent risk that suppressing one dis- 
tortion usually results in other unnecessary additional dis- 
tortions. Deep learning (DL) technology has excellent non- 
linear fitting ability; therefore, learning-based methods have 
significant potential in suppressing multiple distortions (e.g., 
noisy images with mixed blur and white spots) with end-to- 
end processing. For example, DnCNN [19] utilizes convo- 
lutional neural networks (CNNs) to mitigate manifold dis- 
tortions present in natural images. Subsequently, CBDNet 
[20] was proposed as a two-stage multi-distortion suppression 


network to enhance the robustness in tackling various distor- 
tions. RIDNet [21] was proposed to handle mixed Gaussian 
and Poisson noise scenarios with optimal efficiency and flex- 
ibility. In addition, generative adversarial networks (GANs) 
[22] can generate realistic images to augment image datasets 
and address the issue of limited training samples. Therefore, 
they have attracted considerable attention recently [23]. 


However, because of the different distortion types of NRIs 
compared with natural images, existing image datasets and 
learning-based distortion suppression methods for natural im- 
ages are not directly applicable to NRIs. Therefore, in this 
study, we developed a novel DL-based multi-distortion sup- 
pression network with self-built neutron radiographic image 
datasets to improve the visual quality of real NRIs. The pro- 
posed network learns the abstract relationship between la- 
tent clear images and degraded images with multiple distor- 
tions through end-to-end training, which can realize multi- 
distortion suppression in a single step without mutual interfer- 
ence. In addition, neutron radiographic image datasets with 
various types and levels of distortion were built, thereby mak- 
ing the proposed network suitable for NRIs. 


The main contributions of this study are summarized as 
follows: 


(1) A novel multi-distortion suppression network, which 
consists of four cascaded residual attention block (RAB) units 
and a GAN, was developed. 

(2) Large-scale NRI datasets were constructed for the first 
time to render the proposed network suitable for NR. Mixed 
noise, geometric unsharpness, and white spots at different 
levels were randomly combined to enrich the datasets. 

(3) Because of the lack of quality assessment methods for 
NRIs with multi-distortions, several evaluation dimensions 
were adopted to evaluate the performance of the proposed 
method, including subjective and objective metrics. 

(4) Extensive experiments demonstrated that the proposed 
method can effectively suppress various noises, blur, and 
white spots existing in real NRIs and achieve state-of-the-art 
perceptual visual quality. 

The remainder of this paper is organized as follows. Sec- 
tion 2 introduces the proposed multi-distortion suppression 
method, including the analysis of NRI degradation mod- 
els, NRI dataset construction, design of multi-distortion sup- 
pression network, network training, and testing. Section 3 
presents a comprehensive comparison of the results of the ex- 
periments and analyses. Finally, we summarize the conclu- 
sions drawn from this study in Section 4. 


Il. METHOD 


A block diagram of the proposed multi-distortion suppres- 
sion method for NRIs is shown in Figure 1. The following 
two stages are depicted: NRI dataset construction, and design 
and validation of the proposed multi-distortion suppression 
network. 


A. Model analysis of degraded NRIs 


Owing to the physical limitations of CNR systems, low- 
flux NRIs typically suffer from multiple severe distortions, 
including noise, geometric unsharpness, and white spots. As 
the DL-based method requires a large number of clear and de- 
graded images to learn the abstract relationship, we designed 
three types of NRI degradation models to simulate as many 
authentic distortion types as possible; these are expressed in 
the following equations. 


g=p(D*H*f)+n (1) 


where g denotes the real NRIs obtained from the imaging sys- 
tem, f represents the latent clear images, H is the Gaussian 
blur kernel, D denotes the defocus blur kernel, x is the convo- 
lution operation, p(-) denotes the Poisson noise interference 
function, and n denotes the additive Gaussian noise with a 
mean of zero and variance of a”. The geometric instability of 
NRIs can be regarded as a Gaussian blur and defocus blur, as 
adopted in [24, 25]. 

On the basis of (1), we define the second model of NRIs 
with white spots as follows: 


g=p(DxH« f)+nt+w (2) 


where w denotes additive white spots. In addition, the third 
model of NRIs with gamma distribution noise is given as 


g=(G)p(D* H x f)+n+w (3) 


where G denotes the function of the multiplicative gamma 
noise interference. The three proposed degradation models 
consider a comprehensive range of potential distortion types 
existing in real NRIs. 


B. NRI dataset construction 


Although there are many public image databases for DL- 
based image processing, most are designed for natural im- 
ages. Owing to the scarcity of available neutron sources and 
the high cost of NR, obtaining NRIs is considerably more dif- 
ficult than obtaining natural images. To our best knowledge, 
open-access datasets for NRIs have not been reported. Con- 
sequently, natural image datasets have been used as substi- 
tutes for NRI processes [26, 27]. However, owing to different 
imaging principles and distortion types [28], existing natu- 
ral image datasets cannot provide an ideal effect. Therefore, 
we built NRI datasets for the first time to enhance the perfor- 
mance of the proposed method for NR. 

Well-captured NRIs obtained from the reactor and large- 
scale accelerators were chosen as ideal clear images (i.e., 
original images). Then, degradation models (1), (2), and 
(3) were randomly applied to the original images to obtain 
distorted images with different levels and types. Both 
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Fig. 1. The block diagram of the proposed method. 


the original and simulated distorted images were used to 
construct the NRI training datasets. The detailed simulation 
operations are as follows: 


Distortion 1: Gaussian noise 

Gaussian noise is the most widespread noise in all image 
types. We generated a set of 20 random numbers that 
conformed to a uniform distribution in the range (0-0.03) as 
the variances of the Gaussian noise. By using the function 
“imnoise(/,’ gaussian’,m, var_gauss)" in MATLAB, the 
distortion images with different-level Gaussian noise can be 
obtained. Here, J denotes the original image, ‘gaussian’ 
denotes the noise type, m denotes the mean value, and 
var_gauss denotes the variance, respectively. Not all 
degraded NRIs can be improved to a good visual quality; 
thus, the parameter selection is empirical according to the 
image screening condition. 


Distortion 2: Poisson noise 

As the neutron fluence rate fluctuates significantly in 
time and space, NRIs inevitably suffer from distortion of 
the Poisson distribution noise, which is also called shot 
noise. It can be simulated using the MATLAB function 
“imnoise(/,’ poisson’)". When the intensity of the Poisson 
noise becomes sufficiently large, it degenerates into Gaussian 
noise. 


Distortion 3: Gamma noise 

Gamma noise is not the main distortion type in NRIs. 
However, to make the simulated images more consistent 
with the real NRIs, we further use the MATLAB function 
“gamrnd(-)" to enrich the datasets. Although gamma noise is 
not necessary for the majority of NRIs, a dataset with gamma 
noise has been shown to be highly effective in certain special 


NRIs. 


Distortion 4: Unsharpness(i.e., blur) 

Ideally, the neutron source and beam in NR systems should 
be point-like and parallel. However, owing to the size of the 
neutron sources, the collimator ratio (i.e., L/D, where L is the 
length of the beam collimator, and D is the diameter of the 
neutron source), and the distance between the object and the 
scintillation screen, NRIs are usually shown with geometric 
unsharpness. As the generation of defocus blur in an imaging 
system is similar to the geometric unsharpness of NRIs 
[29], we used defocus blur to approximate the geometric 
unsharpness. To simulate this process, we randomly select 
the defocus blur kernel with the size from 1 to 15 for 30 
times by using the MATLAB functions “fspecial(-)" and 
“imfilter(-)." 


Additionally, when a single neutron is absorbed by the 
scintillation screen, the spot dispersion generated at the 
scintillation screen causes inherent unsharpness, which can 
be characterized as a two-dimensional Gaussian function. 
Therefore, Gaussian blur was employed to approximate the 
inherent unsharpness. To simulate this process, we randomly 
select the Gaussian blur kernel with the size from 1 to 15 for 
30 times by using the MATLAB functions “fspecial(-)" and 
“imfilter(-)". The standard deviation of the two-dimensional 
Gaussian kernel function can be adjusted with reference to 
the kernel size (e.g., 1/3 or 1/6). 

Distortion 5: White spots 

During the NR imaging process, the neutron-nucleus in- 
teractions generate high-energy particles (e.g., X-rays and 
y-rays), which generate white spots upon collision with the 
imaging detector. Furthermore, the photosensitive element 
accumulates charge clouds imbued with radiation energy, 
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Fig. 2. Various white-spot images. (a), (b) real white spots with low resolution; (c), (d) simulated white spots with low resolution in previous 
works; (e), (f) real white spots with high resolution; and (g) and (h) simulated white spots with high resolution upon using the proposed 


method). 


gradually diffusing and affecting multiple pixels, yielding 
white spots. Among the various distortions that exist in NRIs, 
white spots are the most conspicuous and detrimental to im- 
age quality. In previous studies, white spots were simulated 
using only a few fixed shapes, which were not sufficiently 
realistic [11]. Therefore, we leveraged the capability of the 
GAN model to emulate real-world data so as to simulate 
white spots with enhanced authenticity and diversity [30]. 
Because the GAN model requires real samples to learn its 
essence, we collected white-spot samples from real NRIs with 
multiple distortions to ensure the feature consistency of the 
simulated white spots. After extensive training with 14,000 
iterations, the generated white spots were highly similar to 
the real white spots and showed a remarkable level of fidelity 
and authenticity as compared with those in the previous stud- 
ies. The comparison results are shown in Figure 2. 

On the basis of the aforedescribed distortion simulations, 
we built three multi-distortion datasets of NRIs by using data 
augmentation techniques. For dataset A, real and clear NRIs 
were first selected as the original input images, which were 
then processed using defocus blur, Gaussian blur, Gaussian 
noise, and Poisson noise according to (1). Then, dataset B 
was constructed according to (2) with additional white spots 
compared with dataset A. Finally, we constructed dataset C 
with additional gamma noise compared with dataset B for 
some special NRIs. These datasets are illustrated in Figure 
3 


C. Multi-distortion suppression network 


The overall architecture of the multi-distortion suppression 
network based on the GAN framework is shown in Figure 4; it 
mainly consists of two crucial components, namely, the gen- 
erator and discriminator. The primary objective of the pro- 
posed network is to reconstruct latent clear NRIs from input- 
degraded NRIs with multi-distortions. The GAN model is 
employed to learn the true distribution of the input samples 
Plata(£) by using the generator G. Meanwhile, the discrimi- 
nator is used D to determine the authenticity of the generated 
samples. Through iterative training, G can generate samples 
with a high degree of fidelity. 


z E€ F > G > x = G(z) ~ Po(2) % Paata(z) (4) 
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Fig. 3. Illustration of the self-built datasets of NRIs. 


where z denotes the data conforming to an arbitrary distribu- 
tion of F, and x denotes the output of generator G. After the 
iterations, the generator output P¢(x) progressively approxi- 
mates the true distribution of Puata(x). The visual represen- 
tation of the generator and discriminator is given as 


z > G > Treal U Z fake > D => (Real/Fake) (5) 


The mathematical description of the GAN model employed 
in this study is given as 


min min V (D, G) = 
G D 
Erwporiginara l 0JD(2)+Ez~p taegradea) [log 1—D(G(z)))] 
(6) 


where x denotes the real and clear NRIs with high resolu- 
tion, and z denotes the generated samples with degradation 
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Fig. 4. Proposed multi-distortion suppression network. 


processing. 


1. Generator architecture 


The generator mainly includes the components for fea- 
ture extraction, residual unit, and upsampling reconstruc- 
tion. Specifically, feature extraction of degraded input im- 
ages is performed using a 7 x 7 convolutional operation. 
Subsequently, two consecutive downsampling operations— 
convolution and pooling—are applied to reduce the dimen- 
sionality of the feature maps. These feature maps are then 
fed into four cascaded RAB units to further learn the essen- 
tial characteristics. To reconstruct latent clear images, two 
transposed convolutions are incorporated into the network for 
upsampling. Skip connections play a vital role in connecting 
feature maps of the same size obtained from both the upsam- 
pling and downsampling stages, allowing for the network to 
accommodate inputs with varying dimensions. Finally, the 
output image was obtained using a 7 x 7 convolutional layer. 

The first component of the RAB unit is the context block 
(CB), which addresses the issue of reduced image resolution 
resulting from excessive pooling operations. The CB employs 
four dilated convolutions with dilation rates of 1, 2, 3, and 4 
to expand the receptive field by injecting holes into the con- 
volution map. This enables the network to capture a broader 
context without further reducing the image resolution. Fol- 
lowing the CB, two residual connections are integrated into 
the RAB unit. The final component of the RAB unit is the 
coordinate attention block (CAB), which leverages two one- 
dimensional global pooling operations performed along the 
vertical and horizontal directions to aggregate the input fea- 
tures into two separate feature maps. Long-range spatial de- 
pendencies along each direction can be captured by encod- 
ing specific directional information in the input feature maps. 


Consequently, attention maps are generated using the saved 
position information. The two attention maps are then mul- 
tiplied by the input feature maps to guide the network in fo- 
cusing on the regions of interest. The CAB can distinguish 
spatial directions (i.e., coordinates) and generate coordinate- 
based attention maps, thereby effectively integrating spatial 
cues into the attention mechanism. The output of the RAB 
can be expressed as 


Yeli, j) = teli, j) x wh) x OPE) (7) 


where x, and ye respectively denote the input and output of 
CAB corresponding to the c-th channel, (i, j) denotes the co- 
ordinate position; x” and g” denote the horizontal and ver- 
tical attention weights with encoded positional information, 
respectively. 


2. Discriminator architecture 


The discriminator architecture consists of eight convolu- 
tional modules. In addition, a leaky ReLU activation function 
is employed to address the problem of the vanishing gradient. 
As the network depth increases, the number of learned fea- 
tures progressively expands, whereas the spatial dimensions 
of the features gradually decrease. Finally, the fake and real 
probabilities of the reconstructed NRIs are obtained using two 
fully connected layers and a sigmoid activation function. 


D. Model training 


The NRIs of the built datasets are randomly cropped into a 
series of 128 x 128 subimages as training samples. We define 


a and p as the degraded images and corresponding ground 
truth, respectively. The training pair in each iteration is de- 
fined as (a;, 8i), where the batch size N is set to 16. 
The loss function significantly influences the effectiveness 
of model training. Currently, the most commonly used loss 
functions in neural networks are L1 and L2 loss functions. 
L2 loss exhibited a higher degree of confidence in handling 
Gaussian noise, whereas L1 loss demonstrated superior ro- 
bustness against outliers [31]. The L1 and L2 losses can be 
mathematically expressed as 


L1 = ||F (a;) — Bill (8) 


L2 = ||F(a:) — Bill? (9) 


Considering the presence of multiple distortions in the 
NRIs, the Huber loss function is employed for generator train- 
ing. The main difference between the Huber and L1 loss 
functions lies in the nonuniqueness of the derivative of L1 
loss at the origin, which may hinder convergence. The Huber 
loss function entails the utilization of the modified L1 and L2 
losses on when the discrepancy in the predicted value F (a;) 
and ground truth 8; is large or small (i.e., absolute difference 
less than 1), respectively. Thus, the Huber loss function com- 
bines the advantages of both L1 and L2 loss functions. For 
a small discrepancy, the gradient remains relatively small, re- 
sulting in a smoother loss function compared to the standard 
Li loss. Moreover, for a larger discrepancy, the gradient is 
sufficiently small to avoid gradient explosions existing in the 
regular L2 loss. The mathematical expression for the Huber 
loss is given as 


|F(ai) — Bil <1 


. F F aa D, 
Hater =} (ai) — Bi) | (10) 
otherwise 


|F (ai) — i| — 0.5, 


For discriminator training, the binary cross-entropy (BCE) 
loss function is utilized; this can be mathematically expressed 
as 


n~ n~ 


BCE = —(Clog(¢) + (1—G)log1—¢)) AD 


where ¢ is the input to the discriminator and Cis the predicted 
value. During the training process, Adam [32] optimizer is 
employed with an initial learning rate of 0.01. In addition, 
100 iterations (i.e., epochs) are performed to update the net- 
work parameters and optimize the network performance. 


Il. EXPERIMENTAL RESULTS AND ANALYSIS 


This section details the extensive comparative experiments 
performed on real NRIs with multiple distortions. Because 
most of the prevalent learning-based image-distortion sup- 
pression algorithms are designed for some common distor- 
tions in natural images (e.g., additive white Gaussian noise 


and JPEG compression distortion), their application effect 
on NRIs with special distortion types is limited. Therefore, 
we selected RIDNet [21], a top-performing model for real- 
world noisy photograph denoising tasks, along with the well- 
performing CBDNet [20], to serve as comparative bench- 
marks for the proposed method. The experimental param- 
eters were set to their default values as specified in the lit- 
erature. All experiments were performed on a workstation 
equipped with an AMD 3700X CPU and an NVIDIA RTX 
2080Ti GPU. 


A. Suppression results for real NRIs with severe noise 


Image denoising is the most fundamental and important 
task in image processing. Several noise suppression algo- 
rithms have been proposed. We selected ImageJ [12], the 
most widely used software in NR, and mainstream learning- 
based RIDNet [21] to verify the superiority of the proposed 
method. As evident from Figure 5, the proposed method ex- 
hibits the best visual quality for noise suppression. 
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Fig. 5. Suppression results for different methods on real NRIs with 
severe noises. 


Given the lack of ideal reference NRIs, classical full- 
reference image quality assessment (IQA) methods (e.g., 
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Fig. 6. Suppression results of different 


peak signal-to-noise ratio (PSNR) [33]) and gradient mag- 
nitude similarity deviation (GMSD) [34]) cannot be used to 
evaluate the quality of the aforedescribed suppression results. 
Therefore, a no-reference image quality metric, RBNIQM, 
designed for NRIs [35] was employed to provide an objective 
quantitative evaluation. RBNIQM can predict the quality of 
NRIs with multi-distortions, including Gaussian noise, Pois- 
son noise, and blur. The prediction scores of the RBNIQM 
method fall within the range of O~1, and a lower prediction 
score indicates a higher image quality. An objective evalu- 
ation of the suppression results in Figure 5 via RBNIQM is 
presented in Table 1. 


Table 1. Objective evaluation of suppression results in Figure 5 via 
RBNIQM 
Figure 5 
Score 


RIDNet 
0.2651 


ImageJ 
0.3259 


Proposed 
0.1936 


As evident from Table 1, the objective evaluation was con- 
sistent with the perceptual visual quality depicted in Figure 
5. 


B. Suppression results for real NRIs with severe blur 


Thus far, deblurring of NRIs remains a major challenge. 
Figure 6(a) shows two real NRIs: a small motor and a 
floppy disk drive, from top to bottom [36]. The small mo- 
tor and floppy disk drive images were obtained using a small 
L/D value of 115 and a near imaging distance equal to 
its own width, thereby leading to significant blur distor- 
tion rather than noise. The traditional steering-kernel-based 
Richardson—Lucy algorithm (SK-RL) [37], BM3D frames, 
and nonlinear variance stabilization (BM3D frames)[17], as 
well as learning-based RIDNet [21] and CBDNet [20] were 
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methods on the real NRIs with severe blur. 


considered for comparison with the proposed method on these 
two images, as shown in Figure 6(b)~(f). Notably, the sup- 
pression results in Figure 6(f) were obtained by the proposed 
method with dataset A. The visual results of Figure 6(a)~(f) 
also indicate that the proposed method shows the best distor- 
tion suppression performance in terms of blur compared with 
the other four methods. 

Next, we used the RBNIQM method to quantitatively eval- 
uate the suppression results in Figure 6. Further, Table 2 indi- 
cates that the objective quality evaluation exhibited good con- 
sistency with visual perception. In addition, learning-based 
CBDNet and RIDNet show superiority in multi-distortion 
suppression compared to traditional image-processing meth- 
ods such as SK-RL and BM3D frames. This is mainly be- 
cause learning-based models exhibit good capability for ab- 
stract high-level feature (e.g., deep network) extraction rather 
than the low-level feature (e.g., time-domain or frequency- 
domain features) extraction of traditional methods. The pre- 
ceding discussion substantiates the efficacy of the proposed 
methodology in addressing distortions, particularly in the 
case of blur. 


Table 2. Objective evaluation of suppression results in Figure 
6(b)~(f) via RBNIQM 
Figure 6 ® © @ © O 
Small motor {0.1297 0.1235 0.0930 0.0899 0.0791 
Floppy disk drive |0.1394 0.1479 0.1298 0.0924 0.0815 


C. Suppression results for real NRIs with severe white spots 


Figure 7(a) shows two other real NRIs, a large motor and a 
bottle, from top to bottom. Unlike the NRIs shown in Figure 
6 with severe blur, these two images were mainly degraded 
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Fig. 7. Suppression results of different methods on the real NRIs with severe white spots. 


with white spots. From the perspective of human perception, 
white-spot distortion has a greater significance level than var- 
ious types of noise. Therefore, white-spot suppression is cru- 
cial for NRIs. 

ImageJ [18] is the most widely used software for white- 
spot removal by professionals in the NR field. In addition, the 
SK-RL [37], BM3D frames, nonlinear variance stabilization 
(BM3D frames) [17], improved robust principal component 
analysis (IRPCA) [11], RIDNet [21], CBDNet [20] and the 
proposed method were employed to demonstrate the multi- 
distortion suppression effects in Figures 7(b)-(h). The sup- 
pression results of Figure 7(h) from top to bottom were ob- 
tained by the proposed method with datasets C and B. A sub- 
jective comparison of the results in Figure 7 indicates that the 
BM3D frames outperformed the traditional SK-RL and clas- 


sical ImageJ in terms of white-spot removal. ImageJ demon- 
strated effectiveness in white-spot removal. The main ad- 
vantages lie in user-friendly operation and easy access to the 
Internet. As regards BM3D frames, the filter inevitably in- 
duces additional blur, which is not beneficial for subsequent 
defect identification and measurement tasks. Compared with 
IRPCA, RIDNet, and CBDNet, the proposed method always 
shows the best visual perception in both white-spot removal 
and noise and blur suppressions. The efficacy of the proposed 
method in handling the first image in Figure 7 is attributed 
to the incorporation of the degradation model (expressed in 
(3)). The first image in Figure 7 contains not only prominent 
white spots but also diverse noise (e.g., Gaussian noise, Pois- 
son noise, and gamma noise). As regards the second image 
in Figure 7, the effectiveness of the proposed method can be 


attributed to the adoption of the GAN model with the coor- 
dinate attention mechanism, which can effectively boost the 
capability of the proposed network for feature extraction in 
the area of interest. This also helped the proposed method 
outperform other learning-based methods (i.e., RIDNet and 
CBDNet) when using the same datasets. 

Because existing IQA methods do not consider white spots, 
evaluation of the suppression results regarding white spots is 
a significant challenge. Therefore, both subjective and objec- 
tive metrics were employed to evaluate the performance of 
the proposed method and its counterparts. Four no-reference 
quality assessment methods, namely, BIQAA [38], BLIINDS 
[39], NIQE [40], and RBNIQM, were chosen as the objec- 
tive metrics and compared with a subjective metric (i.e., mean 
opinion score (MOS)). The normalized scores predicted by 
the four no-reference quality assessment methods are shown 
in Figure 8. Except for RBNIQM, all the other methods 
showed better image quality with higher scores. 


—s— MOS \ 
—e— BLIINDS \ 
- a- NIQE \ 
—v-- RBNIQM \ 


Score 


© © @ w 
Method 


Fig. 8. Line graphs of predicted scores in Figure 7 with different 
no-reference quality evaluation methods. 


The black line in Figure 8 denotes the MOS trend obtained 
by averaging the subjective scores from the following two 
groups of evaluators: professional researchers with experi- 
ence in NR and other researchers without relevant experi- 
ence. Specifically, the NRIs processed using different meth- 
ods were first randomly shuffled, and the evaluators (25 in 
each of the professional and nonprofessional groups) were 
thereafter instructed to rank the images in ascending order of 
quality and assign scores incrementally from one. Finally, the 
average scores from different groups were computed accord- 
ing to the weights of 0.7 and 0.3, respectively, for the profes- 
sional and nonprofessional groups as the subjective quality 
scores for each method (Table 3). 

The trend lines in Figure 8 show that the score curves de- 
viate severely from the subjective scores, indicating their in- 
ability to accurately assess the quality of NRIs with white 
spots. Although the RBNIQM method shows a relatively 
steady trend compared to the subjective quality assessment, 
the minimal variations indicate its drawback of low sensitivity 


Table 3. Subjective quality scores of Figure 7(b)~(h) 


Groups b) © @d © © 9) h 
Professional. | 2.13 2.85 3.95 4.35 4.10 5.86 6.37 


Nonprofessional} 2.06 2.54 3.46 4.28 4.96 5.75 5.98 
Integrated 


2.109 2.757 3.705 4.329 4.530 5.805 6.175 


to white spots. After an extensive comparison with state-of- 
the-art distortion suppression methods, we considered three 
representative methods—ImageJ, IRPCA, and the proposed 
method—to illustrate the local details of white-spot suppres- 
sion (Figure 9). 


(b)Image J 


(c)IRPCA (d)Proposed 
Fig. 9. Illustrations of local details of NRI with different suppression 
methods 


Evidently, the ImageJ method fails to eliminate white 
spots. It can only remove the brightest pixels of the white 
spots and exhibits inferior performance in preserving fine de- 
tails. The IRPCA method achieves satisfactory results in re- 
moving white spots but has a limited capability in preserv- 
ing image details. The proposed method effectively removes 
white spots and noise with good detail preservation. 

To further validate the exceptional efficacy of the proposed 
method in suppressing white spots in NRIs, the same back- 
ground regions (i.e., the red box in the machine image) of the 
NRI with different distortion suppression methods are shown 


machine 


(e)CBDNet 


(f)RIDNet 
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(g)IRPCA (h)Proposed 


Fig. 10. 3D grayscale distribution of a local region in NRI with different suppression methods 


from the perspective of a three-dimensional (3D) grayscale 
distribution in Figure 10. On the basis of the pixel distribution 
of the red-box region in Figure 10(b)~(h), we can conclude 
that both the IRPCA method and proposed method exhibit 
remarkable white-spot suppression effects. As the selected 
region is a background with no useful object information, a 
smoother 3D grayscale distribution is preferred. 


(a)Origin 


(c)SK-RL 


(d)Proposed 


Fig. 11. Illustrations of multi-distortion suppression effects on a real 
NRI obtained by a D-T neutron-tube source 


Without loss of generality, the real NRI obtained by the 
CNR system is shown in Figure 11 to further demonstrate the 
effectiveness of the proposed method. This image was ob- 
tained in 1972 using an A-711 D-T neutron tube with a small 
L/D value of 7.5. The low neutron flux of the neutron tube 
required a long exposure time of 90 min. However, the image 
quality was inferior to that of NRIs obtained by the reactor. 
Next, ImageJ, SK-RL, and the proposed method were em- 
ployed to demonstrate the multi-distortion suppression per- 
formance. As evident from the comparison, the ImageJ and 


SK-RL methods exhibit fewer effects than the original image. 
In contrast, the proposed method can improve image quality 
in terms of noise, blur, and even color restoration to a certain 
extent. Notably, the proposed method has good generaliza- 
tion ability in improving the visual quality of various NRIs 
including thermal neutron radiographic images and fast neu- 
tron radiographic images. Although the energy spectra of the 
neutrons used for NR differ, the resulting images have simi- 
lar image characteristics (e.g., radiographic images) and de- 
graded models (e.g., Gaussian noise, Poisson noise, blur, and 
white spots). 


D. Guidance on the selection of datasets 


As DL-based methods heavily rely on dataset design for 
specific targets, we herein provide recommendations on the 
selection of appropriate datasets for different NRIs. Dataset 
A was mainly designed for blur and noise and is suitable for 
handling noisy NRIs with severe blur. Building on dataset 
A, dataset B considers the white-spot distortion type. As a 
result, dataset B can be considered as the most widely used 
dataset for suppressing multi-distortion in real NRIs. Addi- 
tionally, there may also exist NRIs with severe distortions. 
We recommend the use of dataset C to obtain remarkable re- 
sults. However, the training time and recovery performance 
for most NRIs were not as favorable as those in the case of 
dataset B. Notably, the proposed method emphasizes multi- 
distortion suppression rather than a single distortion type in 
NRIs. Multi-distortion suppression can be realized in NRIs 
in a single training step by selecting the appropriate dataset. 


IV. CONCLUSION 


In this study, we devised a novel multi-distortion suppres- 
sion method based on a modified generative adversarial net- 
work (GAN) to improve the visual quality of degraded NRIs. 
To address the lack of NRI datasets, we built a series of real 


NRI datasets with various types and levels of distortion for 
training the proposed network. In addition, a coordinate at- 
tention mechanism was incorporated in the backbone network 
(i.e., GAN) to promote the capability of the proposed network 
to learn the abstract relationship between ideally clear and de- 
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